NoiseSPY: a real-time mobile phone platform for urban noise monitoring and mapping

In this paper we present the design, implementation, evaluation, and user experiences of the NoiseSpy application, our sound sensing system that turns the mobile phone into a low-cost data logger for monitoring environmental noise. It allows users to explore a city area while collaboratively visualizing noise levels in real-time. The software combines the sound levels with GPS data in order to generate a map of sound levels that were encountered during a journey. We report early findings from the trials which have been carried out by cycling couriers who were given Nokia mobile phones equipped with the NoiseSpy software to collect noise data around Cambridge city. Indications are that, not only is the functionality of this personal environmental sensing tool engaging for users, but aspects such as personalization of data, contextual information, and reflection upon both the data and its collection, are important factors in obtaining and retaining their interest

The roles of emojis in mobile phone notifications

The texts in mobile messages are not always easy to decipher since tone and body language is removed from the context. Emojis offer an attractive way to express emotions to avoid misunderstandings of message tone. In this paper we shed the light on the roles of Emojis in phone notification, we conducted an in-situ study to gather phone notification data. We outline the relationship between Emojis and various social network applications including WhatsApp, Facebook and Twitter. Early results allow us to draw several conclusions in relation to number, position, type and sentimental value of Emojis. It turns out that most popular Emojis in one social app is not as popular in the others. Emojis sentimental polarity in Twitter is high and overall number of Emojis is less than Facebook. The sentimental value of Emojis is more meaningful when there are multiple Emoji in one notification

NotiMind: responses to smartphone notifications as affective sensors

Today's mobile phone users are faced with large numbers of notifications on social media, ranging from new followers on Twitter and emails to messages received from WhatsApp and Facebook. These digital alerts continuously disrupt activities through instant calls for attention. This paper examines closely the way everyday users interact with notifications and their impact on users’ emotion. Fifty users were recruited to download our application NotiMind and use it over a five-week period. Users’ phones collected thousands of social and system notifications along with affect data collected via self-reported PANAS tests three times a day. Results showed a noticeable correlation between positive affective measures and keyboard activities. When large numbers of Post and Remove notifications occur, a corresponding increase in negative affective measures is detected. Our predictive model has achieved a good accuracy level using three different classifiers "in the wild" (F-measure 74-78% within-subject model, 72-76% global model). Our findings show that it is possible to automatically predict when people are experiencing positive, neutral or negative affective states based on interactions with notifications. We also show how our findings open the door to a wide range of applications in relation to emotion awareness on social and mobile communication

EmoEcho: a tangible interface to convey and communicate emotions

An interactive tangible interface has been developed to capture and communicate emotions between people who are missing and longing for loved ones. EmoEcho measures the wearer’s pulse, touch and movement to provide varying vibration patterns on the partner device. During an informal evaluation of two prototype devices users acknowledged how EmoEcho could help counter the negative feeling of missing someone through the range of haptic feedback offered. In general, we believe, tangible interfaces appear to offer a non-obtrusive means towards interpreting and communicating emotions to others

MobGeoSen: facilitating personal geosensor data collection and visualization using mobile phones

Mobile sensing and mapping applications are becoming more prevalent because sensing hardware is becoming more portable and more affordable. However, most of the hardware uses small numbers of fixed sensors that report and share multiple sets of environmental data which raises privacy concerns. Instead, these systems can be decentralized and managed by individuals in their public and private spaces. This paper describes a robust system called MobGeoSens which enables individuals to monitor their local environment (e.g. pollution and temperature) and their private spaces (e.g. activities and health) by using mobile phones in their day to day life

TinyDigitalExposome: the opportunities of multimodal urban environmental data and mental wellbeing on constrained microcontrollers

The increasing level of air pollutants (e.g. particulates, noise and gases) within the atmosphere are impacting mental wellbeing. In this poster, we define the term 'TinyDigitalExposome' that takes us closer towards understanding the opportunity between environment and wellbeing using constrained microcontrollers. Specifically, we propose the opportunity of collecting particulate matter to infer mental wellbeing states whilst can have in the real-world

LabelSens: enabling real-time sensor data labelling at the point of collection using an artificial intelligence-based approach

In recent years, machine learning has developed rapidly, enabling the development of applications with high levels of recognition accuracy relating to the use of speech and images. However, other types of data to which these models can be applied have not yet been explored as thoroughly. Labelling is an indispensable stage of data pre-processing that can be particularly challenging, especially when applied to single or multi-model real-time sensor data collection approaches. Currently, real-time sensor data labelling is an unwieldy process, with a limited range of tools available and poor performance characteristics, which can lead to the performance of the machine learning models being compromised. In this paper, we introduce new techniques for labelling at the point of collection coupled with a pilot study and a systematic performance comparison of two popular types of deep neural networks running on five custom built devices and a comparative mobile app (68.5-89% accuracy within-device GRU model, 92.8% highest LSTM model accuracy). These devices are designed to enable real-time labelling with various buttons, slide potentiometer and force sensors. This exploratory work illustrates several key features that inform the design of data collection tools that can help researchers select and apply appropriate labelling techniques to their work. We also identify common bottlenecks in each architecture and provide field tested guidelines to assist in building adaptive, high-performance edge solutions

iFidgetCube: Tangible Fidgeting Interfaces (TFIs) to monitor and improve mental wellbeing

The ability to unobtrusively measure mental wellbeing states using non-invasive sensors has the potential to greatly improve mental wellbeing by alleviating the effects of high stress levels. Multiple sensors, such as electrodermal activity, heart rate and accelerometers, embedded within tangible devices pave the way to continuously and non-invasively monitor wellbeing in real-world environments. On the other hand, fidgeting tools enable repetitive interaction methods that may help to tap into individual’s psychological need to feel occupied and engaged; hence potentially reducing stress. In this paper, we present the design, implementation, and deployment of Tangible Fidgeting Interfaces (TFIs) in the form of computerised iFidgetCubes. iFidgetCubes embed non-invasive sensors along with fidgeting mechanisms to aid relaxation and ease restlessness. We take advantage of our labeling techniques at the point of collection to implement multiple subject-independent deep learning classifiers to infer wellbeing. The obtained performance demonstrates that these new forms of tangible interfaces combined with deep learning classifiers have the potential to accurately infer wellbeing in addition to providing fidgeting tools

The impact and challenges of livestock tracking in internetless environments with tiny ML

The use of technology within the area of Farming is becoming a more widely discussed area usually referred to as Smart Farming. As more technologies are being introduced into the area and more proposals are made, the area of smart farming is allowing farmers to increase their overall yield. The use of tinyML could bring real benefits to smart farming, specifically within Livestock tracking and monitoring. The concept of processing data in real-time on devices makes sense within this area, as the communication is naturally limited. This is because outside the range of Wi-Fi our devices rely on cellular masts that are provided by telecommunications companies. Telecommunication companies will normally conclude that masts in urban areas such as a town or city are more valuable to them as a company, as they are more likely bring in new customers and clients. While in rural areas they may conclude a mast is unlikely to bring in barely any new clients. From a business perspective, this makes complete sense as there would less use of the mast to justify the upkeep and maintenance of it. This leaves rural areas with either limited or no internet access across large areas of land and due to this, farms that could benefit from new and upcoming technology could be missing out. There are several benefits that tinyML could bring to farming, especially in the area of livestock monitoring. Benefits such as animal behavioral analysis, fall and accident detection, abnormal temperature detection and other potential anomalies within animals